1 link tagged with all of: speculative generation + realtime interaction + steering
Click any tag below to further narrow down your results
Links
Spaceship is an open-source experimental interface where you steer an LLM's text generation live, like flying a ship, with knobs for attention, vector steering, and scrubbing through alternate futures. It's a prototype for how interaction might feel once models can generate at 60 FPS, built by Chuanqi Sun as groundwork for his MIT Media Lab thesis.
- Four interaction prototypes: a focus monitor showing what the model attends to, attention lock to bias future output toward chosen phrases, vector steering that decomposes a task into eigenvectors you tune and recombine, and realtime regeneration you can scrub through.
- Making it feel realtime required aggressive speculative generation and careful cache invalidation; for example, moving the main knob backward empties future text and cancels in-flight requests. The author says Claude Code couldn't one-shot these judgment calls.
- It runs in the browser with Cerebras or Gemini API keys stored in local storage, and community projects like a VSCode extension and a local-model browser version already build on it.